Web Survey Bibliography
Relevance & Research Question:
Drop outs - people leaving a survey before completing it – are a very common problem in online studies. Whereas, some design-related measures to reduce drop out-rates have been implemented (for an overview see Fan & Yan, 2010), it is to date unclear what kind of internal factors of participants (e.g., personality, motivation) affect drop out. In the present study we analyzed whether the Big Five personality factors and participant’s choice of reimbursement has an effect of respondents motivation to continue filling out a web survey.
Methods & Data:
N = 3,013 individuals (71.6% women, mean age M = 23.4 years, SD = 3.9 years) took part in an online-study. After choosing the preferred kind of reimbursement (deciding to be paid by participating in a lottery or through a personality feedback), participants filled out a brief measure of the Big Five. To provoke drop out, several large personality questionnaires followed divided into eight blocks of 40-60 items each. Completing all 460 questions of the whole study took participants on average 63.0 minutes (SD = 21.4 minutes). Using discrete-time survival analysis, the effect of the five personality dispositions and choice of reimbursement on drop out was investigated.
Results:
Only 736 participants (24.4%) completed the whole online-survey. We found that drop out was influenced by individual’s openness, their agreeableness and the their choice of reimbursement: People who were more open to experiences, more agreeable, as well as those who chose to get personality feedback instead of participating in a lottery were less likely to quit participation. Importantly, the effect of all three variables was mediated by satisfaction with the questionnaire in the previous questions block. That is, all three variables lead to a higher satisfaction which in turn lowered the probability to quit the survey.
Added Value:
While we have good knowledge which design-related measures helps us to reduce drop out, little is known about personality aspects that could lead to survey non-response. Our study shows which Big Five personality aspects moderate drop out. Thus, relevant personality aspects are identified and should thus be additionally considered in future studies.
GOR Homepage (abstract)
Web survey bibliography - Germany (361)
- Experiments in Obtaining Data Linkage Consent in Web Surveys ; 2013; Sakshaug, J. W., Kreuter, F.
- On the Impact of Response Patterns on Survey Estimates from Access Panels; 2013; Enderle, T., Muennich, R., Bruch, C.
- Evaluating the left‐right dimension: Category Selection Probing conducted in an online access...; 2013; Huefken , V.
- Methodological, legal and technical perspectives on the feasibility of web survey paradata in German...; 2013; Sattelberger, S.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- The Relation of Survey Topic and Participation Behavior. Analyzing Unit Nonresponse using web-generated...; 2013; Zillmann, D., Schmitz, A., Blossfeld, H. P.
- Web questionnaires in official population surveys: Do's and don'ts First experiments and impacts...; 2013; Blanke, K.
- Möglichkeiten zur impliziten Messung von Emotionen am Beispiel webcambasierter Gesichtsausdruckserkennung...; 2013; Wachenfeld, A., Moentmann, A., Bernet, F.
- Mode effects in Labour Force Surveys - do they really matter?; 2013; Koerner, T.
- Identifying and Mitigating Satisficing in Web Surveys: Some Experimental Evidence; 2013; Rossmann, J.
- Does left still feel right? The optimal position of answer boxes in Web surveys - revisited; 2013; Lenzner, T., Kaczmirek, L.,Galesic, M.
- Latent legitimacy: joint effects of religious orientation on the association between values and acceptance...; 2013; Henseler, A. K., Siegers, P., Beckers, T.
- Identifying Satisficing Respondents in Web Surveys: A Comparison of Different Response Time-Based Approaches...; 2013; Rossmann, J.
- Comparison of quality of web survey and CATI data using unobtrusive response latencies; 2013; Mayerl, J.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- Using Eye Tracking Data to Understand Respondent's Processing of Rating Scales; 2013; Kunz, T., Fuchs, M.
- Advancing the field of questionnaire translation - identifying problems, discussing methods, pushing...; 2013; Behr, D., Dorer, B., Van Houten, G
- European Values Study - methodological and substantive applications; 2013; Luijkx, R., Jagodzinski, W.
- The Impact of Culture and Economy on Values and Attitudes; 2013; Duelmer, H., Voicu, M.
- Educational attainment in cross-national surveys: instrument design, data collection, harmonisation...; 2013; Schneider, S.
- Mode Effects in Mixed-Mode Surveys: Prevention, Diagnostics, and Adjustment 1; 2013; de Leeuw, E. D., Dillman, D. A., Schouten, B.
- Data Collection in Sociolinguistics: Methods and Applications; 2013; Mallinson, C., Childs, B., Van Herk, G.
- Use of Drag-and-Drop Rating Scales in Web Surveys and Its Effect on Survey Reports and Data Quality; 2013; Kunz, T.
- Online Panels: Recruitment Based on “Hot Topics” – What are the Consequences?; 2013; Andreasson, M., Martinsson, J.
- The Effectiveness of Mailed Invitations for Web Surveys; 2013; Bandilla, W., Couper, M. P., Kaczmirek, L.
- Pros and cons of virtual interviewers – vote in the discussion about surveytainment; 2013; Póltorak, M., Kowalski, J.
- The fish model: What factors affect participants while filling in an online questionnaire?; 2013; Mohamed, B., Lorenz, A., Pscheida, D.
- Interview Duration in Web Surveys: Integrating Different Levels of Explanation; 2013; Rossmann, J., Gummer, T.
- The monetary value of good questionnaire design; 2013; Tress, F.
- Technical and methodological meta-information on current practices in online research: A full population...; 2013; Burger, C., Stieger, S.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Measuring wages via a volunteer web survey – a cross-national analysis of item nonresponse; 2013; Steinmetz, S., Annmaria, B.
- Does one really know?: Avoiding noninformative answers in a reliable way.; 2013; de Leeuw, E. D., Boevee, A., Hox, J.
- Sensitive Topics in PC and Mobile Web Surveys; 2013; Mavletova, A. M., Couper, M. P.
- Mobile Research Performance: How Mobile Respondents Differ from PC Users Concerning Interview Quality...; 2013; Schmidt, S., Wenzel, O.
- Who responds to website visitor satisfaction surveys?; 2013; Andreadis, I.
- Measuring working conditions in a volunteer web survey; 2013; de Pedraza, P., Villacampa, A.
- Sampling online communities: using triplets as basis for a (semi-) automated hyperlink web crawler.; 2013; Veny, Y.
- Why are you leaving me?? - Personality predictors of answering drop out in an online-study; 2013; Thielsch, M., Nestler, S., Back, M.
- Propensity Score Weighting – Can Personality Adjust for Selectivity?; 2013; Glantz, A., Greszki, R.
- Research Design as an Influencing Factor for Reliability in Online Market Research; 2013; Wengrzik, J., Theuner, G.
- Ethics, privacy and data security in web-based course evaluation; 2013; Salaschek, M., Meese, C., Thielsch, M.
- Seducing the respondent – how to optimise invitations in on-site online research?; 2013; Póltorak, M., Kowalski, J.
- Influence of mobile devices in online surveys; 2013; Maxl, E., Baumgartner, T.
- E-questionnaire in cross-sectional household surveys; 2013; Karaganis, M.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Online Survey – Research with children on advertising impact; 2013; Funkenweh, V., Busch, J., Amthor, A. L., Boeer, A., Gaedke, J.
- HTML5 and mobile Web surveys: A Web experiment on new input types; 2013; Funke, F.